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Abstract — It is now well known that the performance of a lin¬ 
ear code C under iterative decoding on a binary erasure channel 
(and other channels) is determined hy the size of the smallest 
stopping set in the Tanner graph for C. Several recent papers re¬ 
fer to this parameter as the stopping distance s of C. This is some¬ 
what of a misnomer since the size of the smallest stopping set in 
the Tanner graph for C depends on the corresponding choice of 
a parity-check matrix. It is easy to see that s ^ d, where d is the 
minimum Hamming distance of C, and we show that it is always 
possible to choose a parity-check matrix for C (with sufficiently 
many dependent rows) such that s = d. We thus introduce a new 
parameter, termed the stopping redundancy of C, defined as the 
minimum number of rows in a parity-check matrix H for C such 
that the corresponding stopping distance s{H) attains its largest 
possible value, namely s{H) = d. We then derive general bounds 
on the stopping redundancy of linear codes. We also examine 
several simple ways of constructing codes from other codes, and 
study the effect of these constructions on the stopping redundan¬ 
cy. Specifically, for the family of binary Reed-Muller codes (of 
all orders), we prove that their stopping redundancy is at most 
a constant times their conventional redundancy. We show that the 
stopping redundancies of the binary and ternary extended Golay 
codes are at most 34 and 22, respectively. Finally, we provide up¬ 
per and lower bounds on the stopping redundancy of MDS codes. 

Index Terms —erasure channels, Golay codes, iterative decod¬ 
ing, linear codes, MDS codes, Reed-Muller codes, stopping sets. 


I. Introduction 

T he recent surge of interest in the binary erasure channel 
(EEC) is due in large part to the fact that it is the prime 
example of a channel over which the performance of iterative 
decoding algorithms can be analyzed precisely. In particular, 
it was shown by Di, Proietti, Telatar, Richardson, and Urb- 
anke [7] that the performance of an LDPC code (and, in fact, 
any linear code) under iterative decoding on the EEC is com¬ 
pletely determined by certain combinatorial structures called 
stopping sets. A stopping set 5 in a code C is a subset of the 
variable nodes in a Tanner graph for C such that all the neigh¬ 
bors of S are connected to S at least twice. The size s of the 
smallest stopping set was termed the stopping distance of C 
in a number of recent papers [14], [19]. The stopping distance 
plays an important role in understanding the performance of 
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a code under iterative decoding over the EEC, akin to the role 
played by the minimum Hamming distance d for maximum- 
likelihood and/or algebraic decoding. Just as one would like to 
maximize the minimum distance d if maximum-likelihood or 
algebraic decoding is to be used, so one should try to maximize 
the stopping distance s in the case of iterative decoding. 

There is, however, an important difference between the min¬ 
imum distance d and the stopping distance s. While the former 
is a property of a code C, the latter depends on the specific 
Tanner graph for C or, equivalently, on the specific choice of 
a parity-check matrix H for C. In order to emphasize this, we 
will henceforth use s(H) to denote the stopping distance and 
d(C) to denote the minimum distance. 

In algebraic coding theory, a parity-check matrix H for a lin¬ 
ear code C usually has n — dim(C) linearly independent rows. 
However, in the context of iterative decoding, it has been alre¬ 
ady observed in [20], [24] and other papers that adding linearly 
dependent rows to H can be advantageous. Certainly, this can 
increase the stopping distance s(H). Thus, throughout this pa¬ 
per, a parity-check matrix for C should be understood as any 
matrix H whose rows span the dual code C^. Then the redun¬ 
dancy r(C) of C may be dehned as the minimum number of 
rows in a parity-check matrix for C. Analogously, we dehne 
the stopping redundancy p(C) of C as the minimum number of 
rows in a parity-check matrix H for C such that s(H) = d(C). 
This work may be thought of as the first investigation of the 
trade-off between the parameters p(C), r(C), and d{C). 

In the next section, we first show that the stopping redun¬ 
dancy p(C) is well-defined. That is, given any linear code C, 
it is always possible to find a parity-check matrix H for C such 
that s(H) = d(C). In fact, the parity-check matrix consisting 
of all the nonzero codewords of the dual code has this 
property. Hence p(C) ^ — 1 for all binary linear codes. 

We then show in Section II that if d(C) ^ 3, then any parity- 
check matrix H for C satisfies s{H) = d{C), so p(C) = r(C) 
in this case. The main result of Section II is an extension of this 
simple observation to a general upper bound on the stopping 
redundancy of binary linear codes (Theoreir®. We also derive 
in Section II a general lower bound on the stopping redundancy 
of linear codes (Theorem®- 

In Section III, we study several simple ways of constructing 
codes from other codes, such as the direct-sum construction 
and code extension by adding an overall parity-check. We 
investigate the effect of these constructions on the stopping 
redundancy. It should be pointed out that although we have 
focused our discussion on binary codes in Sections II and III, 
most of the results therein extend straightforwardly to linear 
codes over an arbitrary finite field. 

We continue in Section IV with an in-depth analysis of the 
well-known [u, u-\-v) construction, and in particular its appli¬ 
cation in the recursive definition [17, p. 374] of binary Reed- 
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Muller codes. By slightly modifying this construction, we es¬ 
tablish a strong upper bound on the stopping redundancy of 
Reed-Muller codes of arbitrary orders. Specihcally, we prove 
that if C is a Reed-Muller code of length 2”* and order r, then 
p(C) ^ d(C)r(C)/2. Thus for any constant d(C), we have 
an increase in redundancy by only a constant factor. 

In Section V, we study the (24,12,8) extended binary Golay 
code ^24 the (12,6,6) extended ternary Golay code Qi2- 
We prove that p(l?24) ^ 34 and p(l?i 2 ) ^ 22 by providing 
specific parity-check matrices for these codes. We take ^24 as 
a test case, and compare the performance of three different 
decoders: a maximum-likelihood decoder, an iterative decoder 
using the conventional 12 x 24 double-circulant parity-check 
matrix of [17, p.65], and an iterative decoder using the 34 x 24 
parity-check matrix with maximum stopping distance. In each 
case, exact analytic expressions for the probability of decoding 
failure are derived using a computer program (see Figure 1). 

In Section VI, we consider MDS codes over Fg with cj ^ 2. 
It is easy to extend the general bounds of Section II to q-ary 
codes. However, in Section VI we establish much better upper 
and lower bounds on the stopping redundancy of MDS codes. 
Notably, all these bounds are independent of the field size q. 

This paper only scratches the surface of the many interesting 
and important questions that arise in the investigation of the 
stopping redundancy. We conclude in Section VII with a brief 
discussion and a list of open problems. 

II. General Bounds 

We begin with rigorous definitions of the stopping distance and 
the stopping redundancy. Let C be a binary linear code and let 
H = [hj^j] be a parity-check matrix for C. The corresponding 
Tanner graph T for C is a bipartite graph with each column 
of H represented by a variable node and each row of H re¬ 
presented by a check node in such a way that the j-th variable 
node is connected to the ;-th check node if and only if hj j ^ 0. 
As already mentioned, a stopping set in T is a subset S of the 
variable nodes such that all the check nodes that are neighbors 
of a node in S are connected to at least two nodes in S. We 
dispense with this graphical representation of stopping sets in 
favor of an equivalent definition directly in terms of the under¬ 
lying parity-check matrix H. Thus we say that a stopping set is 
a set of columns of H with the property that the projection of 
H onto these columns does not contain a row of weight one*. 
The resulting definition of the stopping distance - the smallest 
size of a stopping set - bears a striking resemblance to the de¬ 
finition of the minimum Hamming distance of a linear code. 

Recall that the minimum distance of a linear code C can be 
defined as the largest integer d(C) such that every d(C) — 1 or 
less columns of H are linearly independent. For binary codes, 
this is equivalent to saying that d{C) is the largest integer such 
that every set of d(C) — 1 or less columns of H contains at 
least one row of odd weight. 

'This explains why stopping sets stop the progress of an iterative decoder. 
A row of weight one — equivalently, a check node of degree one — would 
determine unambiguously an erased symbol. However, if an entire stopping set 
is erased, then all the neighboring check nodes are connected to these erasures 
at least twice, and thus form an under-constrained system of linear equations. 
In this case, an iterative decoder has no way of determining the erased values. 


Definition 1. Let C be a linear code (not necessarily binary) 
and let H be a parity-check matrix for C. Then the stopping 
distance of H is defined as the the largest integer s{H) such 
that every set of s(H) — 1 or less columns of H contains at 
least one row of weight one. 

The following corollary is an immediate consequence of jux¬ 
taposing the definitions of s{H) and d(C) above. 

Corollary 1. Let C be a linear code and let H be an arbitrary 
parity-check matrix for C. Thens{H) ^ d(C). 

Indeed, it is well known [7], [9], [14] that the support of every 
codeword is a stopping set, which is another way to see that 
s(H) ^ d(C) regardless of the choice of H. Thus given a lin¬ 
ear code C, the largest stopping distance one could hope for 
is d(C), no matter how cleverly the Tanner graph for C is con¬ 
structed. The point is that this bound can be always achieved 
by adding dependent rows to H (see Theorem|2j. This makes 
the notion of the stopping distance, as a property of a code C, 
somewhat meaningless: without restricting the number of rows 
in a parity-check matrix for C, we cannot distinguish between 
the stopping distance and the conventional minimum distance. 
This observation, in turn, leads to the following definition. 

Definition 2. Let C be a linear code with minimum Hamming 
distance d(C). Then the stopping redundancy of C is defined 
as the the smallest integer p(C) such that there exists a parity- 
check matrix H for C with p(C) rows and s{H) = d(C). 

The following theorem shows that the stopping redundancy 
is, indeed, well-defined. 

Theorem 2. Let C be a linear code, and let H* denote the pari¬ 
ty-check matrix for C consisting of all the nonzero codewords 
of the dual code . Then s{H*) = d(C). 

Proof: Let [C^] denote the |C^| x n matrix consisting of 
all the codewords of C^. It is well known (cf. [17, p.l39]) that 
[C^] is an orthogonal array of strength d(C) — 1. This means 
that any set of f ^ d(C) — 1 columns of [C^] contains all the 
vectors of length t among its rows, each vector appearing the 
same number of times. In particular, any set of d(C)—1 or less 
columns of [C^] contains all the vectors of weight one among 
its rows. Clearly, the all-zero row can be removed from [C^] 
to obtain H* while preserving this property. ■ 

Theorem|2l also provides a trivial upper bound on the stop¬ 
ping redundancy. In particular, it follows from Theorem|2lthat 
p(C) ^ — 1 for any binary linear code C. This bound 

holds with equality in the degenerate case of the single-parity- 
check code. The next theorem determines p(C) exactly for all 
binary linear codes with minimum distance d(C) ^ 3. 

Theorem 3. Let C be a binary linear code with minimum dist¬ 
ance d{C) ^ 3. Then any parity-check matrix H for C satisfies 
s{H) = d(C), and therefore p(C) = f'(C). 

Proof: If H contains an all-zero column, then it is obvious 
that s{H) =d(C) = 1. Otherwise s(H) ^ 2, since then every 
single column of H must contain a row of weight one. Now, 
if d(C) = 3, then every two columns of H are distinct. This 
implies that these two columns must contain either the 01 row 
or the 10 row (or both). Hence s(H) = 3. ■ 
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The following theorem, which is our main result in this sec¬ 
tion, shows that Theoreml^is, in fact, a special case of a gen¬ 
eral upper bound on the stopping redundancy of linear codes. 

Theorem 4. Let C be a binary linear code with minimum dist¬ 
ance d{C) ^ 3. Then 


p(C) < 




+ • • • + 


{ r{C) \ 
\d{C) - 2) 


( 1 ) 


Proof: We first prove a slightly weaker result, which is con¬ 
ceptually simpler. Namely, let us show that 


p(C) ^ 




+ • • • + 


( r{C) \ 
\d{C) - l) 


( 2 ) 


Let H be an arbitrary parity-check matrix for C with r(C) lin¬ 
early independent rows. Construct another parity-check matrix 
H' whose rows are all the linear combinations of t rows of H, 
for all f = 1,2,... ,d{C) — 1. Clearly, the number of rows of 
H' is given by the right-hand side of 0. Now let Ht, respec¬ 
tively Hj, denote a matrix consisting of some f columns of H, 
respectively the corresponding t columns of H'. Observe that 
for all f ^ d{<C) — 1, the t columns of Ht are linearly indepen¬ 
dent. This implies that the row-rank of Ht is t, and therefore 
some t rows of Ht must form a basis for F^. Hence the 2^ — 1 
nonzero linear combinations of these t rows of Ht generate all 
the nonzero vectors in F^, including all the vectors of weight 
one. But for t ^ d{C) — 1, the 2^ — 1 nonzero linear combin¬ 
ations of any t rows of Ht are among the rows of H^ by con¬ 
struction. This proves that s{H') = d{C) and establishes (|2}. 

To transition from (|2} to 0, observe that we do not need to 
have all the nonzero vectors of F^ among the rows of H'f, it 
would suffice to have at least one vector of weight one. Given 
a set 5 C F2 and a positive integer m, let mS denote the set 
of all vectors obtained as a linear combination of at most m 
vectors from S. Define p(f) as the smallest integer with the 
property that for any basis B of F^, the set p(f)B contains at 
least one vector of weight one. Then in the construction of H\ 
it would suffice to take all the linear combinations of at most 
p(d(C) — 1) rows of H. Clearly p(f) ^ f — 1 for all t (in fact, 
li{t) = t — 1 for all t), and the theorem follows. ■ 

The bound of Q, while much better than p(C) ^ 2’’('^) — 1, 
is still too general to be tight for most codes. Nevertheless, we 
can conclude from Theorerr0 that when d(C) is a constant, 
the stopping redundancy is only polynomial in the (conven¬ 
tional) redundancy and, hence, in the length of the code. 


In the next theorem, we provide a general lower bound on 
the stopping redundancy of linear codes. 

Theorem 5. Let C be an arbitrary linear code of length n. For 
each i = 1 , 2 ,..., d(C) — 1, define 


Then 


def f 

'n -h 1 

Wj = max < 


1 

i 



(3) 


p(C) ^ 




n—zvA 

i-l) 


for i = 1 , 2 ,..., d(C) — 1 


Proof: Let H be a parity-check matrix for C and let I be 
an arbitrary set of i column indices. We say that T is an i-set. 


We also say that a row h of H covers X if the projection of h 
onto X has weight one. If s(H) = d(C), then each of the (”) 
i-sets must be covered by at least one row of the parity-check 
matrix, for all ; = 1,2,..., d(C) — 1. Any single row of H of 
weight zv ^ n — i 1 covers exactly 

r r ^ def fn-zv\ 

fn{l,w) = (4) 

f-sets. It is not difficult to see that the expression in 0 in¬ 
creases monotonically as w decreases until fn{h tv) reaches its 
maximum at lu = \{n-\- l)/i] — 1. But wt(/i) ^ d(C^) for 
all rows h of H. Thus each row of H covers at most f„ [i, 10 f) 
f-sets, where tu, is defined in 0, and the theorem follows. ■ 


Is there an asymptotically good sequence of linear codes 
Ci,C2 ,... such that the stopping redundancy p(C,) grows 
only polynomially fast with the length? The answer to this 
question is unknown at the present time. However, if the dual 
sequence C^,... is also asymptotically good, we can use 
Theorem|3to settle this question in the negative. 

Corollary 6. Let Ci, C2 ,... be an infinite sequence of linear 
codes of strictly increasing length nt and fixed rate kt/nt = R, 
with 0 < R < 1 , such thatd{<Ci) jn^ ^ 5i for all i, with 5i > 0 . 
If also d{Cj-)/ni ^ 62 for all i, with 82 > 0, then 


PiQ) = n 



- (d-^ 2 )Hz 



wheren = andH 2 {x) = xlog2X (1—x) log 2 (l—x) ^ 

is the binary entropy function. 


Proof: We apply the bound of Theorem|3with the size of an 
f-set given by d(C) — 1. It is easy to see that if d(C;)/n, ^ 
and d{C^)/rtt ^ 82 for all f, then the maximum in is attai¬ 
ned at d(C^) for all sufficiently large i. Thus 


PiQ) ^ 


( ” 
\d{Q)-l 



fn-diC^)\ 

\diCi)-2) 


^ 2^fiH&z) Si I 7t{1-8i-82) 

" n 4(1-<5 i)( 1-<52) 

where/(61, 62) = H2(6i) - (l-62)H2 (^i/(l- 52 )) and the 
second inequality follows from well-known bounds [17, p.309] 
on binomial coefficients in terms of H 2 {-). ■ 

We observe that the function f{ 8 i, 82 ) defined in the proof 
of Corollary|6l is always positive, and therefore p(Q) indeed 
grows exponentially with the length n. Note that several well- 
known families of asymptotically good codes (for example, the 
self-dual codes [16]) satisfy the condition of Corollaryl^ 


III. Constructions of Codes from Other Codes 

In this section, we examine several simple ways of construct¬ 
ing codes from other codes. While for most such constructions, 
it is trivial to determine the redundancy of the resulting code, 
we find it considerably more difficult to determine the resulting 
stopping redundancy, and resort to bounding it. 
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We start with two simple examples. The first example (Theo- 
re mQ is the well-known direct-sum construction or, equiva¬ 
lently, the (m, v) construction. The second one (Theorem|^ is 
the (u,u) construction, or concatenation of a code with itself. 

Theorem 7. Let Ci, C 2 be {ni, ki, di), {n 2 , k 2 , ^ 2 ) binary lin¬ 
ear codes, respectively. Then C 3 = {{u,v) : u gCi,v GC 2 } 
is an (rii -\- n 2 , ki + k 2 , min{di, d 2 }) code with 

p(C3) ^ p(Ci) + p(C 2 ) (5) 


Proof: Let Hi be an arbitrary p(Ci) x n parity-check matrix 
for Cl with s(Hi) = di, and let H 2 be an arbitrary p(C 2 ) x n 
parity-check matrix for C 2 with s(H 2 ) = d 2 . Then 


H3 = 


Hi 0 
0 H 2 


is a parity-check matrix for C 3 . Assume w.l.o.g. that di ^ d 2 , 
so d(C 3 ) = di. Label the columns of H 3 by 1,2,..., ni -|- n 2 , 
and let I be an arbitrary set of at most d{C^) — 1 column ind¬ 
ices. If Tn {1,2,.. .,ni} 7 ^ 0, the fact that s(Hi) = d{C^) 
implies that there is a row of weight one in the projection of 
H 3 onto I. Otherwise I C {«i+l, n 2 + 2 ,... ,nin 2 }, and 
the same conclusion follows from s(H 2 ) = d 2 ^ d{C 3 ). ■ 


Theorem 8 . Let Ci be an (n, k, d) binary linear code. Then the 
code C 2 = {(m, m) : M e Cl} is a {2n, k, 2d) code with 


p(C 2 ) ^ p(Ci)+ n ( 6 ) 


Proof: Let Hi be a p(Ci) x n parity-check matrix for Ci 
with s(Hi) = d. Construct a parity-check matrix for C 2 as 


H2 



0 

In 


where is the n x n identity matrix. Label the columns of H 2 
by 0, 1 ,..., 2n — 1, and assume to the contrary there exists a 
set T C jo, 1,..., 2n — 1} such that \T\ ^ 2d — 1 and there 
is no row of weight one in the projection of H 2 onto I. Let 
H 2 (X) denote this projection. First note that the two identity 
matrices in H 2 imply that if j G I, then also (; + n) mod 2n 
is in X, since otherwise H 2 (X) contains a row of weight one. It 
follows that X n {0,1,..., n —1} 7 ^ 0. But s(Hi) = d, so the 
top part of H 2 implies that | X n{0 ,l,...,n-l} ^ d, other¬ 
wise H 2 (X) again contains a row of weight one. By the first 
observation, we now conclude |X| ^ 2d, a contradiction. ■ 

Here is an interesting observation about Theorems 0 and |3 
It follows from e and © that if the constituent codes are 
optimal, in the sense that their stopping redundancy is equal to 
their redundancy, then the resulting code is also optimal. This 
indicates that the bounds in 0 and © are tight. 

In contrast, the innocuous construction of extending a linear 
code C by adding an overall parity-check [17, p. 27] appears to 
be much more difficult to handle. The next theorem deals only 
with the special case where d(C) = 3. 


Theorem 9. Let C be an (n, k,3) binary linear code. Then the 
extended code C' is an {n -f 1, k, 4) code with 


p(C') ^ 2p(C) = 2 r{C')-2 


Proof: Let H be an arbitrary r(C) x n parity-check matrix 
for C. We construct a parity-check matrix for C' as follows 


H' = 


/H 0 
\H 1 


where H is the bitwise complement of H, while 0 and 1 are 
the all-zero and the all-one column vectors, respectively. Label 
the columns in H' by 1,2,..., n -|- 1, and let X be a subset of 
( 1 , 2 ,...,« 1 } with |X ^ 3. In fact, it would suffice to con¬ 

sider the case where X C {1,2,..., n) and |X| = 3; all other 
cases easily follow from the fact that s(H) = 3 by Theorerr© 
Let H (X) and H (X) denote the projections of H and H, re¬ 
spectively, on the three positions in X. If H(X) contains a row 
of weight one, we are done. If H(X) contains a row of weight 
two, we are also done — then the corresponding row in H (X) 
has weight one. But otherwise, the only rows in H(X) are 
000 and 111, which means that the three columns in H(X) 
are identical, a contradiction since d(C) = 3. ■ 


The construction in Theorerr©is not optimal. For example, 
if C' is the ( 8 ,4,4) extended Hamming code, it produces a pa¬ 
rity-check matrix for C' with 6 rows. However, C' is also the 
Reed-Muller code 7?^ (1,3) for which we give in the next sec¬ 
tion a parity-check matrix H with s(H) = 4 and only 5 rows. 


IV. Reed-Muller Codes 

We now focus on the well-known (u, u -j- v) construction, in 
particular in connection with the recursive definition of binary 
Reed-Muller codes. Our goal is to derive a constructive upper 
bound on the stopping redundancy of TZ(r,m) — the binary 
Reed-Muller code of order r and length 2™. 

We begin by recalling several well-known facts. The reader 
is referred to [17, Chapter 13] for a proof of all these facts. For 
all r = 0 , 1 ,..., m, the dimension of Ti{r, m) is k = L;=o (T) 
and its minimum distance is d = Let G(r, m) be a gene¬ 

rator matrix for TZ{r, m). Then, using the [u, u -i-v) construc¬ 
tion, G{r,m) can be defined recursively, as follows; 


G(r, m) 


def 



1 ) G(r, m — 1) \ 
G{r—l,m—l) J 


(7) 


with the recursion in Q being bootstrapped by G{m,m) = l 2 m 
and G(0, m) = (11 ■ • • 1) for all m. By convention, the code 
Ti{ — l,m) is the set {0} for all m. Then 


= TZ{m — r — l,m) ( 8 ) 


for all m and all r = —1,0,1,... ,m. It follows from © that 
G{r,m) is a parity-check matrix for TZ[m—r—l,m), a code 
with minimum distance 2'^+^. Hence every 2'^+^ — 1 columns 
of G(r,m) are linearly independent. 

Our objective in what follows is to construct an alternative 
parity-check matrix H{r,m) for TZ{ni—r—l,m) = TZ{r,m)-^ 
such that s{H{r,m)) = 2''^^. Then the number of rows in 
H{r,m) gives an upper bound on the stopping redundancy of 
TZ{m—r—l, ni) (and the number of rows in H{m—r—l, m) is 
an upper bound on the stopping redundancy of TZ{r,m)). Here 
is the recursive construction that we will use. 
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Recursive Construction A: For all positive integers m and for 
all r = 1 , 2 ,..., m — 2 , we define: 


H(r,m) = 

^Htop^ 

def 

/ H{r,m-1) H{r,ni-T) \ 
0 H(r— l,?n— 1) 1 


Ubotj 


\H(r— l,m— 1) 0 / 


with the recursion in (IS being bootstrapped as follows: for all 
m = 0,1,..., the matrices H{m—l,m), H{ni,m) 

are defined by 

H(0,m) G(0,m) = (11 ■ ■-1) (10) 

G{m — l,m) (11) 

Hpf 

H{m,m) = G{m,m) = l 2 m (12) 

Proposition 10. H (r, m) is a generator matrix forTZ{r, m) and, 
hence, a parity-check matrix forTZ{m — r — 1, m). 

Proof: The proof is by induction on m and r. Equations dlOt 
to d12t establish the induction base. For the induction step, 
we need to prove that (|9|l generates TZ{r,m), assuming that 
H{r,m — 1) generates TZ{r,m — l) and H(r—l,m—1) genera¬ 
tes TZ{r—l,m — l). It follows immediately from 0 that Htop 
already generates TZ{r,m). Thus it would suffice to show that 
all the rows of Hbot belong to TZ{r, m). To this end, we write 


TZ{r,m) = {(m,M + ii) : ugCi, V&C 2 } (13) 

where Ci = TZ{r, m — 1) and C 2 = TZ^r — 1, m — 1). Observe 
that each row of Hbot can be written as 


( 11 , 0 ) = {v,v) + ( 0 ,ti) 


where v G C 2 . The fact that (0, v) G 7Z(r, m) follows immedi¬ 
ately from ifTlt for w = 0. The fact that {v,v) ETZ{r,ni) also 
follows from dl3> in conjunction with the well-known fact that 
C 2 C Cl (take u := V and v := 0). Hence all the rows of Hbot 
belong to TZ{r,m), and the induction step is complete. ■ 

It remains to show that the stopping distance of H{r,m) is 
indeed 2'^“*'^. We again prove this by induction on m and r. 
Let us first establish the induction base. Trivially, the stopping 
distance of H(0, ni) is 2, since H(0, ni) = (11 ■ ■ ■ 1) by d 12 t . 

Lemma 11. The stopping distance of H{m—1, ni) is 2™. 

Proof: The proof is by induction on m. We start with m = 1, 
in which case we have s(H(0,1)) = 2, as desired. For the in¬ 
duction step, observe that 


H{m — 1, m) 


l2fn—l 12^—^ 

0 H{m—2,m — l) 


The situation here is exactly the same as the one we had in 
the proof of Theorem|3 and the result follows in the same 
manner. As in Theorem|3 assume to the contrary there exists 
a set X C {0,1,..., 2’" — 1} such that |X| ^ 2"^ — 1 and there 
is no row of weight one in the projection of H(m —1, m) on X. 
Then / G X implies that {j mod 2’" is in X. Hence 

X n {2'"“^,.. .,2™ — 1 } 7 ^ 0. But the stopping distance of 
H{m—2,m—l) is 2"*“^ by induction hypothesis, which imp¬ 
lies that { 2 ™“^,..., 2"* — 1} C X. By the earlier observation, 
this means that X = {0,1,..., 2™ — 1}, a contradiction. ■ 


Proposition 12. The stopping distance of H{r,m) is 2’’+^ for 
all positive integers m and for all r = 0,1,... ,m — l. 

Proof: The proof is by induction on m and r. LemmafTTI in 
conjunction with the fact that the stopping distance of H(0, m) 
is 2 establish the induction base. For the induction step, let 
X C {0, 1 ,.. ., 2 ™ — 1 } be a set of column indices such that 
X| ^ 2’^“*“^ — 1. We distinguish between three easy cases. 

Casel: Xn {0,1,.. .,2'”-i-l} = 0 . 

Then X C 1,..., 2”* — l}. By induction hypo¬ 

thesis, the stopping distance of H(r, m — 1) is 2’'~^^. Hence the 
top row in implies that the projection of H{r,m) onto X 
contains a row of weight one. 

Casel: 1^ |Xn {0,1,.. .,2'"-i - 1} | ^ 2’'- 1. 

By induction hypothesis, H(r—l,m—1) has a stopping dist¬ 
ance of 2’’ . Hence the bottom row in I© implies that the proj¬ 
ection of H(r,m) onto X contains a row of weight one. 

Case3: |Xn {0,1,...,2'"-i - 1} | ^ 2^ 

Then | X n {2™"!, 2’”-l+1,..., 2™-1} | ^ 2''- 1, and we 
are in a case that is symmetric to either Case 2 or Case 1. ■ 


The remaining task is to compute the number of rows in the 
matrix H(r,m). We denote this number as g{r,m). 


Lemma 13. For all r = 0,1,. 
H{r,m) is given by 

r 

g{r,m) = ^ 
1=0 


, m — 1 , the number of rows in 
in-r-l-fi^^i 


Proof: Consider the following generating function 

00 m 

= £ lLs{Tm + l)x''y"' 

m—0 r—0 

Note that H{m, m-\-l) = G{ni, ni + 1) for all m ^ 0, in view 
of (IIH . Hence g{ni, m-\-1) = 2"*+^ — 1. Using the recursion 
g{r, m-\-1) = g(r, m) -\- 2g{r — 1, m), which follows imme¬ 
diately from 0 , along with this initial condition, we obtain 


= y/(^/y) + 2xy/(x,y)-h^x'y 

1=0 

Upon rearranging, (HI becomes 


(14) 


f{x,y) = - j -—£ x'y 

l-y{l + 2x)f-^ ^ 


(15) 


The lemma now follows by observing that g{r,m) is the co¬ 
efficient of in (fist . ■ 

We are now in a position to summarize the results of this sec¬ 
tion in the following theorem. 


Theorem 14. For all m = 1,2,... and for allr = 0,1,.. .,m, 
the stopping redundancy of TZ{r, m) is upper bounded by 


p{TZ{r, m)) 


< 


m—r—1 


E 



2 ' 


(16) 
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Proof: Follows immediately from Proposition ! 101 Pro¬ 

position^] and LemmafOl ■ 

To see how far the bound of Theorem } 14 ! is from the (con¬ 
ventional) redundancy of Reed-Muller codes, we first need the 
following technical lemma. 


Lemma 15 . For all positive integers m and aJJ 0 ^ r ^ m 
we have 


E 


i=0 


r—1 -f 


ir-i 



- 1 , 

( 17 ) 


Proof: Denote the sum YJi=o ( 7 ) '')■ Using the well- 

known (7) = (7-1) + (™7^) recursion, we obtain 



and recognize the second term above as 2 S(m—l,r— 1 ). The 
result now follows by induction on m and r. ■ 

Using LemmatfSl we can establish a relation between the re¬ 
dundancy of Reed-Muller codes and their stopping redundan¬ 
cy. For this, it will be more convenient to work with the dual 
code C = TZ{r,ni)^. Recall that r(C) = ( 7 )- Compar¬ 

ing this to the bound on p(C) in TheoremfMl we find that 


p(c) ^ L 

1=0 


m—r—1 + i 


2' ^ 2’'£ 
i=0 


m 


= 2 ''r(C) 


where the second inequality follows from (fTTt . Therefore, for 
any fixed order r, the stopping redundancy of TZ{r,m)^ is at 
most the redundancy of TZ{r,m)^ times a constant. Alterna¬ 
tively, if we take C = TZ{r,m), then TheoremfT^ implies that 
p(C) ^ d(C)r(C)/ 2 . Thus for any fixed d(C), the increase 
in redundancy is by a constant factor. 


V. Golay Codes 

The ( 24 , 12 , 8 ) binary Golay code Q2A U arguably the most re¬ 
markable binary block code. It is often used as a benchmark 
in studies of code structure and decoding algorithms. 

There are several “canonical” parity-check matrices for Q24,, 
see [ 3 ], [ 4 ], [ 23 ] and other papers. Our starting point is the sys¬ 
tematic double-circulant matrix H24 given in Mac Williams and 
Sloane [ 17 ,p. 65 ] and shown in TableHj It can be readily verified 
that s(H24) = 4 , which means that H24 achieves only half of 
the maximum possible stopping distance. Curiously, the stop¬ 
ping distance of the two “trellis-oriented” parity-check matri¬ 
ces for (724. given in [ 23 , p. 2060 ] and [ 3 , p.l 441 ], is also 4 . 

Computing the general bounds of Theorems 0 ] and |3 for the 
special case of Q24, produces the extremely weak result; 

6 ^ p{G2i) ^ 2509 

Having tried several methods to construct a parity-check mat¬ 
rix for Q2i with stopping distance 8, our best result was achi¬ 
eved using a greedy (lexicographic) computer search. Specifi¬ 
cally, with the 4095 nonzero vectors of Q24 listed lexicograph¬ 
ically, we iteratively construct the parity-check matrix H24, at 
each iteration adjoining to H24 the first vector on the list with 
the highest score. Each vector receives i points to its score 
for each yet uncovered f-set it covers, where i G { 1 , 2 ,..., 7 } 


(cf. Theoremj^. The resulting matrix is given in Tablejlj Since 
H24 has only 34 rows and s(H24) = 8, it follows that the 
stopping redundancy of (^24 is at most 34 . 


Two PARITY-CHECK 


H 24 , 


/ 1 1 0 0 
10 10 
10 0 1 
10 0 0 
10 0 0 
10 0 0 
10 0 0 
10 0 0 
10 0 0 
10 0 0 
10 0 0 
\ 0 0 0 0 


H24 


/ 0 0 0 0 
/ 0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 1 
0 0 0 1 
0 0 0 1 
0 0 0 1 
0 0 10 
0 0 10 
0 0 11 
0 10 0 
0 10 0 
0 10 0 
0 10 0 
0 110 
0 111 
10 0 0 
10 0 0 
10 0 1 
10 10 
10 11 
10 11 
10 11 
110 0 
110 0 
110 1 
1110 
\ 1 1 1 1 


TABLE I 

MATRICES FOR THE 


000000000 

000000000 

000000000 

100000000 

010000000 

001000000 

000100000 

000010000 

000001000 

000000100 

000000010 

000000001 


000000110 

000000111 

000011000 

000110001 

001001111 

001101011 

101101000 

111011011 

111100001 

000100000 

100000000 

101110010 

110000011 

001101000 

111110000 

100100110 

000000101 

000010110 

010010100 

011110010 

010010000 

000100000 

001000111 

010000110 

100010000 

000001101 

000000010 

010000001 

100000000 

011000001 

101001100 

000001000 

110010000 

000011000 


(24,12,8) 

110 11 
0 110 1 
10 110 
0 10 11 
0 0 10 1 
0 0 0 1 0 
1 0 0 0 1 
110 0 0 
1110 0 
0 1110 
10 111 
11111 


110 0 1 
0 0 110 
0 0 10 0 
10 110 
110 0 0 
0 0 111 
0 0 10 0 
0 0 0 0 0 
0 0 0 1 0 
0 0 111 
1110 1 
0 0 0 0 1 
1 0 0 0 0 
0 0 0 1 0 
0 10 0 0 
110 0 0 
0 10 10 
110 10 
0 10 0 0 
0 0 0 1 0 
0 10 11 
1 0 0 0 1 
0 0 10 0 
1110 0 
0 0 10 1 
0 0 0 0 0 
0 110 0 
0 0 0 0 1 
1 0 0 0 0 
0 0 0 1 1 
0 0 0 0 0 
1 0 0 0 1 
0 0 0 0 0 
0 0 10 0 


Golay code C /24 

1 0 0 0 1 0 \ 
110001 
111000 
011100 
101110 
110111 
011011 
101101 
010110 
001011 
000101 
111111 / 


0 0 1 1 1 0\ 
110001 
1110 11 
001001 
010000 
000000 
100110 
000100 
100001 
100011 
100100 
100000 
110000 
001011 
000010 
000000 
010110 
000001 
101010 
001000 
010000 
110000 
000110 
100000 
001001 
010011 
001100 
011000 
010101 
000100 
010100 
001100 
001100 
010000/ 


TABLE II 

Number oe undecodable erasure patterns 

BY WEIGHT W IN THREE DECODERS FOR ^24 


zu 

Total Patterns 

'i'ML(lP) 



0 

1 

0 

0 

0 

1 

24 

0 

0 

0 

2 

276 

0 

0 

0 

3 

2024 

0 

0 

0 

4 

10626 

0 

110 

0 

5 

42504 

0 

2277 

0 

6 

134596 

0 

19723 

0 

7 

346104 

0 

100397 

0 

8 

735471 

759 

343035 

3598 

9 

1307504 

12144 

844459 

82138 

10 

1961256 

91080 

1568875 

585157 

11 

2496144 

425040 

2274130 

1717082 

12 

2704156 

1313116 

2637506 

2556402 

^ 13 

(24) 

(24) 

V IP / 

(24) 

\ ui/ 

(24) 

V IP / 











Schwartz and VARDY: ON THE STOPPING DISTANCE AND THE STOPPING REDUNDANCY OE CODES 


7 



Figure 1. The decoding failure probability of three decoders for C/ 24 - a max¬ 
imum-likelihood decoder and iterative decoders based upon H 24 ^nd H 24 


To evaluate the effect of increasing the stopping distance, it 
would be interesting to compare the performance of iterative 
decoders for ^24 based on H24 or H24, respectively. As a base¬ 
line for such a comparison, it would be also useful to have 
the performance of a maximum-likelihood decoder for ^ 24 - In 
what follows, we give analytic expressions for the performance 
of the three decoders on the binary erasure channel (BEC). 

Clearly, a maximum-likelihood decoder fails to decode (re¬ 
cover) a given erasure pattern if and only if this pattern con¬ 
tains the support of (at least one) nonzero codeword of (/24- 
Let ^]y[L(ti;) denote the number of such erasure patterns as 
a function of their weight zv. Then 

24 

Pr ml {decoding failure} = ^ ¥ml(w) 

iv=0 

where p is the erasure probability of the BEC. In contrast, an 
iterative decoder (based on H24 or H24) fails if and only if the 
erasure pattern contains a stopping set. Thus 


24 

Pi'H 24{decoding failure} = 

w =0 

24 

PrH'4{decoding failure} = 

w=0 

where and (w) denote the number of erasure pat¬ 

terns of weight w that contain a stopping set of H24 and H24, 
respectively. It remains to compute ^4424^ ^^24’ ^ML- 

Obviously, T'ml(^) = 0 for tu ^ 7 and ¥ml(^) = (^) 
for w ^ 13 (any 13 columns of a parity-check matrix for CJ24 
are linearly dependent). Eor the other values of w, we have 





8 ^ zu ^ 11 


These functions are given in Tablellll The resulting probabili¬ 
ties of decoding failure are plotted in Eigure 1 . Note that while 
we may add rows to H24 to eliminate more stopping sets, this 
would have negligible effect since the slope of the performance 
curve is dominated by the smallest zv for which Wf^^^(zv) 7^ 0. 

TABLE III 

Two PARITY-CHECK MATRICES EOR THE (12, 6, 6) GOLAY CODE Qu 


/ 

1 

0 

0 

0 0 

0 

0 

1 


1 

1 

1 

1 

\ 

0 

1 

0 

0 0 

0 

1 

0 

1 

— 

— 

1 


0 

0 

1 

0 0 

0 

1 

1 


0 

1 

— 

— 



0 

0 

0 

10 

0 

1 



1 

0 

1 

— 



0 

0 

0 

01 

0 

1 




1 

0 

1 


V 

0 

0 

0 

0 0 

1 

1 

1 



— 

1 

0 

/ 

/ 

0 

0 

0 

0 

0 

1 

1 

1 



1 

0 

\ 


1 

1 

— 

— 

1 

0 

0 

0 

0 

0 

0 

— 



0 

0 

0 

— 

1 

0 

0 

0 

1 

1 

— 

— 



— 

— 

1 

0 

0 

1 

1 

1 

0 

0 

0 

0 



0 

0 

— 

0 

0 

1 

0 

0 

— 

1 

— 

1 



1 

— 

0 

1 

1 

0 

1 

— 

0 

0 

0 

0 



1 

1 

0 

0 

0 

0 

1 

1 

— 

0 

0 

— 



0 

1 

0 

1 

0 

1 

0 

0 

1 

1 

1 

0 



1 

0 

— 

0 

1 

0 

0 

— 

0 

1 

— 

0 



0 

0 

— 

1 

1 

0 

1 

0 

0 

0 

— 

1 



1 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

1 



0 

0 

1 

0 

1 

1 

0 

1 

1 

1 

0 

0 



— 

1 

0 

0 

0 

0 

1 

— 

0 

1 

1 

0 



0 

— 

— 

1 

0 

0 

— 

1 

0 

0 

0 

— 



0 

0 

0 

0 

1 

1 

— 

0 

1 

0 

1 

1 



— 

0 

1 

1 

0 

1 

0 

0 

— 

— 

0 

0 



0 

— 

1 

0 

— 

1 

0 

0 

— 

0 

1 

0 



— 

0 

0 

— 

1 

0 

0 

— 

0 

0 

1 

1 



0 

— 

0 

— 

1 

0 

— 

0 

0 

— 

0 

1 



1 

0 

— 

0 

1 

1 

1 

0 

— 

0 

0 

0 


V 

1 

0 

1 

1 

1 

0 

0 

0 

1 

0 

1 

0 

/ 

0 

1 

0 

— 

— 

1 

0 

0 

0 

0 

— 

1 


TABLE IV 

Number of undecodable erasure patterns 

BY WEIGHT W IN THREE DECODERS FOR Qu 


w 

Total Patterns 

'i'ML(tP) 

'i'Hi2(a') 

't'Hjj)"’) 

0 

1 

0 

0 

0 

1 

12 

0 

0 

0 

2 

66 

0 

0 

0 

3 

220 

0 

20 

0 

4 

495 

0 

150 

0 

5 

792 

0 

456 

0 

6 

924 

132 

758 

377 

> 7 

V w / 

r) 

\w / 

V W / 

vu;/ 


The ( 12 , 6 , 6 ) extended ternary Golay code Q12 is another 
famous code. A systematic double-circulant parity-check mat¬ 
rix for (/12 is given in [ 17 , p. 510 ]; this matrix is denoted H12 
in TableHni It is easy to see that s[Hi2) = 3 , which is again 
half of the maximum possible stopping distance. Using greedy 
lexicographic search, we have constructed a parity-check mat¬ 
rix H}2 with stopping distance 6 and only 22 rows. This matrix 
is also given in Tableinil The number of undecodable erasure 
patterns for a maximum-likelihood decoder and for the itera¬ 
tive decoders based on H42 and H}2 is given in Table llVI 


1771 ( 20-6 720)-6 2576 zv = 12 


VI. MDS Codes 


where we made use of Table IV of [ 5 ] (for zv = 12 , we have 
^ML(ji’) = IX12I + I S12I + III12I in the notation of [ 5 ]). To 
find ^4424(') and nsed exhaustive computer search. 


The last family of codes we investigate are the maximum dis¬ 
tance separable (MDS) codes. These codes have intricate alge¬ 
braic and combinatorial structure [ 17 , Chapter 11 ]. In particu- 
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lar, if C is an (n, k, d) linear^ MDS code, then the dual code 
is also MDS and its distance is = k+ l = n — d + 2 . 
Moreover, every d positions in {1,2,..., n} are the support of 
a codeword of C of weight d, while every d^ positions support 
a codeword of of weight d^. We will use these and other 
properties of MDS codes to establish sharp upper and lower 
bounds on their stopping redundancy. 

Theorem 16 . Let C be an {n, k, d) MDS code with d^ 2 . Then 

< (^2) 

Proof: The lower bound is just a special case of Theorem|3 
Taking ; = d — 1 in 0, we find that 


Next, we use a combinatorial argument to show that d = 2 
is the only case where the lower bound of TheoremfTslis exact. 

Theorem 17 . Let C be an (n, k, d) MDS code with d ^ 3. Then 


p(C) ^ 


1 

f n \ 

d -1 

[d- 2 )\ 


+ 1 


( 20 ) 


Proof: Assume to the contrary that there is a parity-check 
matrix H for C with s(H) = d and at most rows. 

As in Theorem|3 we say that a given set X C {1,2,..., n} 
with |X| = i is an i-set, and that a row h of H covers an ;-set 
X if the projection of /i on X has weight one. The number of 
(d—l)-sets covered by a single row of weight w ^ d^ is 


tv^_i = d(C^) = n — d + 2 

whenever d ^ 2, so that n — = d — 2 . The corresponding 

lower bound in Theorem|3 thus reduces to 


D„,d{w) 


w 


n—iv 

d -2 


iv = d^ = n — d + 2 

( 21 ) 

w > d^ = n — d + 2 


p(C) ^ - 
(n 


n 

d -1 


d + 2 ) 


d -2 

d -2 


— ( ” ) 

d-l\d- 2 j 


(19) 


To prove the upper bound, note that every d-^ = n — d + 2 po¬ 
sitions support a codeword of C^. We take one such codeword 
of for every set of d-^ positions, and use the resulting 

n\ / n \ / n 

d^J ^ \n-d + 2 ) ^ \d -2 

codewords as rows of a matrix H. We claim that H is a parity- 
check matrix for C, namely that rank(H) = n — k = d — 1 . 
Indeed, consider a set of d — 1 positions, say { 1 , 2 ,..., d— 1 }. 
For each i G { 1 , 2 ,..., d— 1 }, there is a row of H of weight 
d-L = n — (d—1) + 1 such that the intersection of its support 
with { 1 , 2 ,..., d— 1 } is {)}. The corresponding d — 1 rows of 
H thus contain an identity matrix on the first d — 1 positions; 
hence rank(H) = d — 1 . It remains to show that s(H) = d. 
But this follows immediately from what we have already prov¬ 
ed; given any set X C { 1 , 2 ,..., n} with |X| = d — 1 , there is 
a corresponding set of d — 1 rows of H whose projection on 
the positions in X is the identity matrix. ■ 

Both bounds in TheorerrJThI are exact if d = 2 . Indeed, for 
d = 2 the upper and lower bounds in (d coincide, yielding 
p(C) = 1 . This reflects the degenerate case of the (n, n — 1 , 2 ) 
MDS code C, whose dual is the {n,l,n) repetition code C^ 
Indeed, any codeword of can serve as a 1 x « parity-check 
matrix H for C with s(H) = 2 . In the case of the (n, 1 , n) re¬ 
petition code C' itself, the bounds in (I 18 > reduce to 

» < ,(C') < ^ 

The true value is p(C') = r(C') = n — 1 . To see this, consider 
an(n—l)xM parity-check matrix H' for C' such that the sup¬ 
port of the f-th row in H’ is {i, z + 1} for i = 1 , 2 ,... ,n — 1 . 


The total number of (d—l)-sets is and everyone of them 
must be covered by at least one row of H. But 


max D„,d(ro) ^ f d- 2 \ 

in view of (ED. It now follows from d that there are exactly 
(d- 2 )/(^“^) rows in H, all of weight w = d^, and that each 
(d—l)-set is covered by exactly one row of H. The latter con¬ 
dition is equivalent to saying that each (complementary) set of 
n — (d— 1 ) = d-'- — 1 positions is contained in the support of 
exactly one row of H. In other words, the supports of the rows 
of H form an 5(d-'- —1, d^, n) Steiner system.^ 

Such a Steiner system may or may not exist. If it does not 
exist we are done, but in many known cases (e.g. S{2,'S,7), 
S{3, 4, 8 ), 5(4,5,11), etc.) it does; hence we must proceed to 
establish another contradiction. To this end, consider a (d—2)- 
set which is the complement of the support of a given row 
of H. As s(H) = d, this (d—2)-set must be covered by some 
other row of H, say /i 2 - But then 



d -1 Vd -2 


( 22 ) 


supp(/li) n supp(/l2) 


d^ - 1 


The above means that there is a set of d^ — 1 positions that 
is contained in two different blocks of the 5(d^ —l,d^,M) 
Steiner system, a contradiction. ■ 

Example. The hexacode Tde is a remarkable ( 6 ,3,4) MDS 
code over F 4 = {0,1, cv,cD}. It is unique up to monomial 
equivalence and self-dual under the Hermitian inner product 
(so the conjugate of a parity-check matrix for Ti(, is a generator 
matrix for Tt^,). The upper and lower bounds in (CD imply 
that 5 ^ ^ 15. Using one of the covering designs (see 

below) in [ 10 ], we construct the following parity-check matrix 


^Throughout this section, we deal with linear MDS codes only. Henceforth, 
whenever we say “an MDS code” we mean a linear MDS code. 


^An S{t,k,v) Steiner system is a set of /:-subsets of {1,2,.. .,v}, called 
blocks, so that each ^-subset of {1,2 ,..., y} is contained in exactly one block. 
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fw 

w 

0 

1 

0 

1\ 

cu 

cu 

1 

0 

1 

0 

0 

1 

ID 

cv 

0 

1 

1 

0 

W 

cu 

1 

0 

0 

1 

0 

1 

ZD 

cu 


0 

1 

0 

ID 

cu) 


for 7^5. It can be easily verified by hand that s(H) = 4 , and 
therefore p{ 7 i(,) ^ 6. Finally, the lower bound of TheoremflTl 
proves that = 6. Thus \ 2 Q\ is exact in this case. □ 

In general, it follows from the proof of TheoremfTTlthat if C 
is an {n,k,d) MDS code and H is a parity-check matrix for C 
with s(H) = d, then the supports of rows of weight in H 
form a (n, d-^, d^ — 1 ) covering design. A {v, k, t) covering de¬ 
sign is collection of subsets of size k of {1,2,.. .,v}, called 
blocks, such that every subset of { 1 , 2 ,... ,v} of size t is con¬ 
tained in at least one block (changing “at least one” to “exactly 
one” thus makes this a Steiner system). The smallest number 
of blocks in a {v, k, t) covering design is usually denoted by 
C{v,k,t) and called the covering number (see [ 11 ], [ 18 ] and 
references therein). Thus if C is an {n,k,d) MDS code, then 

p(C) ^ C{n,d^,d^ — 1 ) = C{n,k-\-l,k) ( 24 ) 


The best general lower bound on the covering number dates 
back to the work of Schonheim [ 21 ], who showed in 1964 that 
C{v,k, t) ^ (v/k) C{v — l,k — l,t — 1 ). For the special case 
of (I 24 > . this proves that 


p(C) ^ 


n 

n — 1 

'n -2 

n—k +1 



k+l 

k 

k -1 

2 




( 25 ) 


Notice that if we ignore all the ceilings in O, then we recover 
precisely the lower bound in ( I 18 > . Hence J 25 > is always at least 
as strong as the lower bound of TheoremfTfil An alternative 
bound on the covering number is due to de Caen [6] (see also 
[ 10 , p. 270 ]). In our case, this bound reduces to 


This is better than the lower bound of TheoremfTfilif and only 
if n > 2 (fc-|-l) = 2 d-^. Note that TheoremfTTi is sometimes 
stronger than both J 25 t and i 26 i . for example in those cases 
where n ^ 2 d^ and an S{k,k-\- l,n) Steiner system exists. 

We can now summarize most of the results in this section 
as follows. If C is an (n, k, d) MDS code over with d ^ 3 , 
the the stopping redundancy of C is in the range 


d - 1 \d- 2 ) 


< P(C) ^ 


max{d^,d—1} f n ^ 
n \d- 2 ) 


(see Appendix for a proof of the upper bound). These bounds 
are reasonably close and, notably, do not depend on the size 
of the field. Determining the stopping redundancy of MDS 
codes exactly appears to be a difficult combinatorial problem. 
In view of (El, it is likely to be at least as difficult as the 
problem of determining the covering number C{n,k-\-l,k). 


VII. Discussion and Open Problems 

This paper only scratches the surface of the many interesting 
and important problems that arise in the investigation of stop¬ 
ping redundancy. The importance of stopping sets is well 
understood in the case of the binary erasure channel. However, 
the concept of stopping redundancy is new. Figure 1 clearly de¬ 
monstrates that it is the stopping sets of size strictly less than 
the minimum distance that are responsible for the performance 
gap between maximum-likelihood and iterative decoding. Thus 
eliminating such stopping sets is what we need to do, and the 
stopping redundancy is the relevant figure of merit. 

It would be extremely interesting to understand how relevant 
stopping redundancy is for other channels. In this regard, it is 
worth mentioning the following observation of Feldman [ 9 , 
p. 176 ]. In the general framework of LP decoding, the support 
of any pseudocodeword is a stopping set for any channel. Thus 
the stopping redundancy might be the relevant figure of merit 
in this, very general, context as well. 

It is interesting to note that although we have defined and 
studied the stopping redundancy as a property of linear codes, 
it turns out to be closely related to a number of well-known 
combinatorial structures. Steiner systems and covering designs 
were already discussed in Section !^ A combinatorial struc¬ 
ture equivalent to a covering design is the Turan system. For 
more information on this, we refer the reader to [ 13 ], [ 18 ], [ 22 ]. 
Another combinatorial concept that is very closely related to 
stopping redundancy is that of fc-locally-thin families. A family 
J- of subsets of the set (1, 2 ,..., p} is said to be k-locally-thin 
if given any k distinct subsets in IF, there is at least one ele¬ 
ment f G {1, 2 ,..., p} that is contained in exactly one of them. 
The central problem in the study of k-locally-thin families is to 
determine M{p,k), defined as the maximum cardinality of a k- 
locally-thin family of subsets of ( 1 , 2 , ...,p}. In particular, 
one would like to determine the sequence 

,(l) « ( 27 ) 

p^oo P 

But M{p,k) is also the maximum number of columns in a bi¬ 
nary matrix H with p rows, distinct columns, and no stopping 
set of size k. Hence, results on stopping redundancy might be 
relevant in the study of fc-locally-thin families, and vice versa. 
For example, our construction in Section lTvl Droduces a parity- 
check matrix for the Reed-Muller code TZ{m — 2 , m) of length 
n = 2 ’", distance 4 , and stopping redundancy (2 + o(l))log2M, 
thereby showing that f ( 3 ) ^ 1 / 2 . It should be pointed out that 
estimating t{k) is a notoriously difficult task. In fact, it is not 
even known whether f ( 3 ) < 1 and whether t{k) decreases mo- 
notonically with k. For much more on this, see [ 1 ], [ 2 ], [ 15 ], 
and references therein. 

We have concluded the original version of this paper with 
a variety of research questions related to our results. Although 
some of these questions have been since answered (see below), 
we repeat them here. In Sectionllll we derived upper and lower 
bounds on the stopping redundancy of general binary linear 
codes. Can these general bounds be improved? In particular, 
is there an asymptotically good family of codes such that their 
stopping redundancy grows only polynomially fast with their 
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length? In Sectionlllll we have examined only a small sample 
of the multitude of known ways of combining codes to con¬ 
struct other codes. What can be said of the stopping redundan¬ 
cy of other constructions, in particular constructions involving 
nonbinary alphabets, such as concatenated/multilevel coding? 
In Sections EYl and lYl we investigated the Reed-Muller codes 
and the Golay codes. Are the constructions provided therein 
optimal? In particular, is it true that p{Q2a) = 34 ? It appears 
that proving lower bounds on the stopping redundancy, even 
for specific codes such as Q24, is quite difficult. Finally, in 
Section lyTI we considered MDS codes. We conjecture that the 
stopping redundancy of an {n,k,d) MDS code C over does 
not depend on the code, but only on its parameters n and k. 
In other words, any two {n,k,d) MDS codes have the same 
stopping redundancy. If this conjecture is true, then it should 
be possible, in principle, to determine the stopping redundancy 
of an {n,k,d) MDS code as a function of n and k. However, 
this appears to be a difficult combinatorial problem. 

Finally, we would like to mention two recent papers that 
are directly inspired by our results, and improve upon them. 
Etzion [8] studies in detail the stopping redundancy of binary 
Reed-Muller codes. He proves that the stopping redundancy 
of TZ{m — 2 ,m), which is also the exteded Hamming code of 
length 2 ™, is 2 m — 1 . This shows that our construction in 
Section lTVl is optimal in this case. However, it turns out that 
this construction is not optimal for the first-order Reed-Muller 
codes 7 ^( 1 , m); Etzion [8] derives a better upper bound on the 
stopping redundancy of these codes. Han and Siegel [ 13 ] use 
the “probabilistic method” to establish upper bounds on the 
stopping redundancy of general linear codes, which improve 
significantly upon our result in Theorem^] They also prove up¬ 
per bounds on the stopping redundancy of MDS codes in terms 
of Turan numbers, that are stronger than our Corollarvl 20 l 


Appendix 

An Improved Upper Bound on the Stopping 
Redundancy of MDS Bounds 

In this appendix, we improve the upper bound in TheorerrJThl 
using constant-weight codes. An (m, 4 ,k;) constant-weight code 
C is a set of binary vectors of length n and weight zv, such that 
any two elements of C are at distance ^ 4 from each other. Let 
U(n,w,m) denote the largest possible cardinality of a union 
of m constant-weight codes, each with parameters (n, 4 , tu). 

Theorem 18 . Let C be an {n, k, d) MDS code with d^ 3 . Set 
m = min{A:, n — k— 1 }. Then 

p(C) ^ (^”2) ~ U{n,d- 2 ,m) ( 28 ) 

Proof: We start as in the proof of TheoremfT^bv construct¬ 
ing a parity-check matrix H for C such that the supports"^ of 
the rows of H are all the binary vectors of length n and weight 

d-L 

= n — d -\- 2 . Now let Ci, C2,... ,Cm be any m constant- 
weight codes with parameters {n, 4 , n—d-\- 2 ). We remove from 

^We shall regard the support of a row of H interchangeably as a subset of 
{1,2,..., n} or as the coiresponding binary vector of length n. 


H all the rows whose supports belong to Ci U C2 U ■ ■ ■ U Cm- 
Let H' denote the resulting matrix. Since obviously 

U{n,n — d-\-2,m) = U{n,d — 2,m) 

the number of rows remaining in H' is given by the right-hand 
side of (Ei, provided Cp, C2, ■. ■ ,Cm are chosen so as to max¬ 
imize the cardinality of their union. We claim that s{H') = d. 
To prove this claim, we distinguish between two cases. 

Case 1: Consider a (d—l)-set. As shown in the proof of Theo- 
re mFThl there are some d — 1 rows in H such that the projection 
of their supports on the (d—l)-set is the (d—1) x (d—1) iden¬ 
tity matrix. Let D C F2” denote this set of d — 1 supports. Any 
two elements of D are at distance exactly 2 from each other, 
since (d— 1 ) -f (d-'- — 1 ) = n. Hence |PnC,j ^ 1 for all i. As 
m^n — k — l = d — 2 = |P| — 1 , it follows that H' contains 
at least one row whose support belongs to D. 

Case 2: Consider a f-set with t ^ d —2 and assume w.l.o.g. 
that this f-set is { 1 , 2 ,..., f}. Note that H contains some d-^ 
rows whose supports are 

{f,f -h 1,..., f + d^} \ {f + ;} for f = 1,2,.. .,d^ 

As before, let D denote this set of d^ supports. The intersec¬ 
tion of each support in D with the f-set {1,2,.. .,f} is {f}, 
so the projection of each of the corresponding d-^ rows of H 
onto this f-set has weight one. Moreover, any two elements of 
D are, again, at Hamming distance 2 from each other. Hence 
|r>nC;j ^ 1 for all i, and since m ^k = d^ —1 = \D\ — 1 , it 
follows that H' has at least one row whose support is in D. 

It remains to show that rank(H^) = n — k = d — 1 . But this 
follows from the fact that s{H') = d. Indeed, up to an appro¬ 
priate column permutation, there is a row in H' such that the 
intersection of its support with {1, 2 ,..., d—1} is {d—1}. 
Then, there is another row in H' such that the intersection of its 
support with (1,2 ,..., d—2} is (d—2}, again up to a column 
permutation. Continuing in this manner, we get a set of d — 1 
rows of H' whose projection on the first d — 1 positions is an 
upper-triangular matrix with nonzero entries on the main dia¬ 
gonal. Hence rank(H') = d — 1 , and we are done. ■ 

Proposition 19. For all positive integers n and w with w ^ n 
and for all m ^ n, 

, , m/n\ 

U(n,zv,m) ^ — (29) 

n \wJ 

Proof: Graham and Sloane [12, Theorem 1] construct a par¬ 
tition of the set of binary vectors of length n and weight w into 
n constant-weight codes with parameters (n, 4 , zv). Taking the 
m largest codes in such a partition proves (I29> . ■ 

Corollary 20. Let C be an (n, k, d) MDS code. Then 

max{d-'-,d—1} / n \ 

'’(C) < „ U-2) W) 

Proof: Follows immediately from Theorem^] and Proposi¬ 
tional Note that coincides with (IT8}iffd = 2. ■ 
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